Heterogeneous patterns enhancing static and dynamic texture classification 
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Some mixtures, such as colloids like milk, blood, and gelatin, have homogeneous appearance when viewed 
with the naked eye, however, to observe them at the nanoscale is possible to understand the heterogeneity 
of its components. The same phenomenon can occur in pattern recognition in which it is possible to see 
heterogeneous patterns in texture images. However, current methods of texture analysis can not adequately 
describe such heterogeneous patterns. Common methods used by researchers analyse the image information 
in a global way, taking all its features in an integrated manner. Furthermore, multi-scale analysis verifies 
the patterns at different scales, but still preserving the homogeneous analysis. On the other hand various 
methods use textons to represent the texture, breaking texture down into its smallest unit. To tackle this 
problem, we propose a method to identify texture patterns not small as textons at distinct scales enhancing 
the separability among different types of texture. We find sub patterns of texture according to the scale 
and then group similar patterns for a more refined analysis. Tests were performed in four static texture 
databases and one dynamic one. Results show that our method provides better classification rate compared 
with conventional approaches both in static and in dynamic texture. 



I. INTRODUCTION 

Pattern recognition is the identification and interpreta- 
tion of patterns in images, in order to extract relevant in- 
formation on the image to identify and classify your con- 
tent. Classification of patterns can be used in a variety of 
applications in different fields such as nanotec hnolo gySMS 
biology3g], mec jj c j n ^ISI anc j computer science^^. Dif- 
ferent approaches have been developed according to the 
application, however, most of them analyze the informa- 
tion in a global way, using all the features in an integrated 
manner. 

One side in the pattern classification approach uses 
multi-scale analysis of patterns, that is, different scales 
of observation are used to perform the analysis and find 
similar patterns, because important struc tures in an im- 
age usually occur at different spatial scalea^El, Methods 
based on textona^SD represent each pixel of a texture 
as the convolution of a multi-scale and multi-orientation 
filter bank producing a texton vocabulary. Thus, these 
methods of texture analysis characterize the image ho- 
mogeneously on the scale to be analyzed. Both the over- 
all analysis, such as multi-scale approach is appropriate 
for the vast majority of problems in pattern recognition. 
However, in some problems, due to the heterogeneous 
nature of the composition of the objects under consider- 
ation, it is needed one more step in the process of pattern 
recognition, the analysis of heterogeneous patterns. 

The aim of this paper is to demonstrate how can apply 
heterogeneous analysis to improve results regarding the 
homogeneous analysis. To validate our proposal experi- 



ments were performed on four static e one dynamic tex- 
ture databases using the same texture descriptor but with 
different approaches. In all tests, heterogeneous analysis 
proved to be better than the homogeneous analysis en- 
hancing the rate classification. 

This paper is organized as follows: Sectio n |H| describes 
the heterogeneous pattern analysis. Section |III| shows the 
results and discussions and in Section HVl the conclusions. 



II. METHOD 

Heterogeneous pattern arises when the object under 
analysis presents combined patterns in its composition. 
Similar to the classic definition of heterogeneous compo- 
sitions in chemical compounds^, which is the character- 
istic of presenting a different appearance or composition 
when analyzed in parts. The same analogy can be ap- 
plied in recognizing patterns in images. In each image 
can be found heterogeneous patterns, i. e., it is possible 
to distinguish the different patterns in each of the tex- 
ture images. Figure 1(a) shows an image from Brodatz, 
which analyzed by conventional methods, would be de- 
fined only a pattern for this image. Using the approach 
of heterogeneous patterns, two different types of texture 
patterns are identified in its formation. 

This new view to analyze the various patterns requires 
a new approach for analysis of similarity between images. 
The first step is to segment the texture by defining re- 
gions where the image belong to a given pattern while 
defining the patterns in the image. Figures 
illustrate the segmentation of the image of 
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two patterns. 

To obtain this result the image was divided into smaller 
sized windows of 8 x 8 pixels, for windows with texture 
sufficiently homogeneous, that is, where only one pattern 
is found. Furthermore, there was obtained a character- 
istic to represent each window. Windows with similar 
characteristics remain the same pattern, and those with 
distinct characteristics were separated into different pat- 
terns. Figures 1(b) | and 1(c) show the windows stayed 
grouped using k-means algorithm according to their pat- 
tern with the remaining windows in each pattern. Tex- 
tural features from Haralick!^ descriptors were used to 
characterize each window. 

Haralick descriptors^ are based on the spatial gray 
level dependence matrices, or co-occurrence matrix. Con- 
trast, Correlation, Energy and Homogeneity were com- 
puted from resulting co-occurrence matrices to obtain a 
set of 32 descriptors for each window. Let G be the gray 
levels and p(i,j) a matrix of relative frequencies of two 
neighboring resolution cell with intensity i and j sepa- 
rated by distance d and direction 8. Extracted features 
are described as follows: 
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images belong to the same class. Figure |2(c) shows an 



example where it is not possible to perform the fitting 
patterns and all possibilities of fitting are tested. In this 
case the images belong to different classes. 

However, this approach has a special feature when the 
same pattern can be found in different classes of tex- 
ture (See Figure [3]). This one influences the analysis of 
the similarity degree between classes, because different 
classes can obtain a high rate of similarity, since some 
patterns will have great matching. 



III. RESULTS AND DISCUSSIONS 

To validate the method of heterogeneous patterns anal- 
ysis, this technique was applied in four different texture 
databases, each with its peculiarities: Brodatz, USPTex, 
Vistex and Outex and one dynamic texture database: 
Dyntex. Figure [4] shows some samples of the texture 
databases and Figure [5] shows examples of dynamic tex- 
ture database Dyntex. The classification method k- 
Nearest Neighbor (k — NN) with 10-fold cross-validation 
scheme was used in all experiments. 



Contrast = J^ J^ (i - j) 2 p{i, j) (1) Brodatz: ^contains 1110 natural textures of 200 x 200 
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pixels divided into 111 classes (Figure 4(a)) 



CorrelaUon = £ £ ^^ _' ^ (2) 
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Energy = J^ ^2p{h jf 
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Vistex: ESI contains 864 images of 128 x 128 pixels size 
with 54 texture classes (Figure |4(b)[ ) . 

USPTex: ^ has 3984 natural texture images of 128 
x 128 pixels size divided into 332 classes (Figure 
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(3) 
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fj, x , fi y , o~ x and a y are, respectively, means and standard 
deviations of the sum of elements of each row and column 
of the co-occurrence matrix. Distances of 1 and 2 pixels 
with angles of 0°, 45°, 90° and 135° were used. 

After the windows were divided into patterns, we per- 
formed a survival analysis of windows, 25% of the win- 
dows with features farthest from the group average were 
discarded making the representation of pattern more con- 
sistent. Each pattern was characterized by a feature vec- 
tor average that is the average of the characteristics of 
all windows belonging to the pattern. The next step is 
to find the best matching among the patterns to define 
the image similarity as Figures 2(a) and |2(b)j exemplify. 
They show two examples where it has an optimal match- 
ing among the image patterns of the same class. When 
the best fit among all the patterns in each image is found, 
we have the degree of similarity, defining whether the 



Outex: BS has 1360 images of 128 x 128 pixels size di- 
vided into 68 classes (Figure [4 (d)[ ). 

Dyntex: ^consists of 1230 videos with 250 frames with 
400 x 300 pixels size divided into 123 classes of 
dynamic texture (Figure pi. 

The method used as classical approach was Haralick 
descriptors with the same configurations of characteri- 
zation of windows. This way we can compare the same 
descriptor but with different perspectives. One of the 
most important parameters is the window size that di- 
rectly interferes in the results. Large windows remain 
with the general representation of the image, preserving 
the homogeneous analysis of patterns. However, becomes 
more homogeneous window, or small windows, the clas- 
sification rate increases, as the representative pattern of 
the window increases. For this experiment two patterns 
were analyzed in each image. Table IT] shows the results 
obtained when using the conventional method in com- 
parison with heterogeneous patterns, in all cases hetero- 
geneous pattern method improved the classification rate 
proving to be better than the standard approach in which 
only one pattern is established for the entire image. 






Figure 1. Segmentation according to the heterogeneous patterns, (a) Original image, (b) and (c) Two patterns obtained from 

(a). 




(a) 




(b) 




(c) 

Figure 2. Matching patterns, (a) and (b) matching of two images from the same class, (c) Matching of patterns can not be 
made because the images belong to different classes. 



Table I. Accuracy rate by comparing the traditional method of analysis with the heterogeneous method. 



Database 



Brodatz Vistex Usptex Outex Dyntex 



Classical approach 88.92 89.47 69.58 76.62 76.89 

Heterogeneous pattern 93.06 93.63 78.49 76.99 98.29 




Figure 3. Same pattern in different classes. 







(d) 



Figure 4. Samples of (a) Brodatz, (b) Vistex, (c) Usptex and (d) Outex. 




Figure 5. Samples images from Dyntex, a dynamic texture database. 



IV. CONCLUSIONS 



the image showing robustness evaluating heterogeneous 
patterns on images. 



Usually, analysis in texture pattern recognition using 
the homogeneous approach taking all the image informa- 
tion in a global way, that is, the entire image is defined 
as one pattern. However, it is possible to find more than 
one texture pattern on the image that we called here, het- 
erogeneous pattern. It is necessary to map the patterns 
in each image and then check the similarity of patterns 
among them. This method improved the accuracy rate 
of classification using the same method to characterize 
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